Abstract
This report contains methods and results of SONAR-based escapement estimates for winter steelhead on the Dungeness River from 2019-2022. Add more
1 Washington Department of Fish & Wildlife
✉ Correspondence: Bethany Craig <Bethany.Craig@dfw.wa.gov>
Let’s begin with a paragraph that’s a more general introduction in terms of why monitoring steelhead in the Dungeness is important? Part of a listed DPS, etc.
Steelhead spawning ground surveys in the Dungeness River basin are inherently challenging due to springtime snow melt and rain events which can lead to high, turbid water and unsafe survey conditions. In most years it is not possible to survey for steelhead through the entirety of the spawning season, and in some years poor survey conditions prevent an adequate number of surveys from being completed to produce an estimate of escapement based on redd counts. SONAR may provide an alternative method for steelhead enumeration and run timing in a dynamic, turbid snow-melt system like the Dungeness watershed. Since 2018 the Washington Department of Fish and Wildlife (WDFW) has operated a stationary multi-beam SONAR unit in the lower Dungeness River to enumerate and gather run-timing information on winter steelhead (Onchorhynchus mykiss).
In 2018 the SONAR unit was deployed at approximately at river mile (RM) 0.2, below the majority of steelhead spawning habitat, and ensonified an approximately 20 meter (m) wide run in the river (Figure 2.1). The SONAR unit was mounted to a pole mount and attached to a reinforced ladder, secured to the river bottom by rebar (Figure 2.2).
Fish frequently milled or held in front of this SONAR site, which made counting fish passage difficult. As a result, in 2019, the SONAR site was moved upstream to approximately RM 0.3, to a site with higher velocity, past which fish actively migrated (Figure 2.3). This site was easily accessible from the field trailer site, which enabled the unit to be directly connected and powered by trailer power, and any adjustments to the SONAR settings to be accomplished in the dry, safe comfort of the trailer.
Figure 2.1: Location of the SONAR site in the lower Dungeness River in 2018 (white) and 2019-2022 (striped).
Figure 2.2: SONAR unit deployment via a pole mount and ladder system in the Dungeness River in 2018.
Midway through the 2019 season the SONAR unit was mounted on a semi-permanent platform along the hardened left bank, in a spot that is protected and retains adequate depth so that the SONAR unit did not need to be shifted laterally to accommodate changing water levels (Figure 2.3).
In all years, a picket weir was constructed approximately 1 m above upstream of the SONAR unit from the bank, extending out to approximately 1 m past the SONAR, to deflect debris (Figure 2.3). A second picket weir was constructed approximately 1 m below downstream of the SONAR unit to direct migrating fish out in front of the unit.
Figure 2.3: SONAR unit deployment via a pole mount and platform in the Dungeness River in 2020. Picket weir is the upstream picket weir.
We deployed the ARIS 1800 Explorer, manufactured by Sound Metrics, of Bellevue, Washington. The ARIS 1800 uses 96 beams at 1.1/1.8 megahertz (Mhz) to project a 28-degree acoustic wedge. The SONAR unit was adjusted to have a pitch of 3.5 degrees to -8 degrees to ensonify the entire water column and channel. The unit was checked daily and adjusted as necessary to maintain full ensonification of the channel. Imagery was continuously recorded 24 hours a day, and saved in 30-minute files, so that 48 individual files were recorded for each full day of operation.
The SONAR was operated from early February or early March through late June or mid- to late July (Table 2.1, Figure 2.4). Other than a 22-day suspension in 2020 due to COVID-19 protocols, there were few outages and gaps in data collection (Table 2.1, Figure 2.4). SONAR imagery was reviewed for steelhead passage from the first day of operation through at least June 22th in each year.
| Year | First Date | Last Date |
|---|---|---|
| 2018 | Mar 07 | Jul 03 |
| 2019 | Mar 05 | Jul 17 |
| 2020 | Feb 13 | Jul 26 |
| 2021 | Feb 01 | Jun 22 |
| 2022 | Feb 09 | Jun 25 |
Figure 2.4: Plot of when SONAR was operational (purple) and not (yellow), from Feb 1 through July 31 each year.
Figure 2.5: Plot of when SONAR was reviewed (purple) and not (yellow), from Feb 1 through July 31 each year.
Because of the immense quantity of SONAR files, and the amount of time it took to process and review each 30-minute file, we initiated a subsampling scheme to enable the project team to complete review of the entire period of steelhead passage. In 2019 - 2022 the first 30 minutes of each hour were processed and reviewed for fish migration. A subset of days was fully reviewed (60 minutes of each hour) to compare fish migration with subsampled data (first 30 minutes of each hour). Another subset of days was double, or triple, reviewed to compare fish counts and lengths among each year’s 2 or 3 data reviewers. Table 2.2 shows what percentage of the hours were reviewed each year, and how much of the steelhead migration season was captured by operational SONAR.
| Year | Hours | Operational (%) | Reviewed (%) |
|---|---|---|---|
| 2018 | 4,343 | 21.9 | 21.9 |
| 2019 | 4,343 | 71.1 | 40.0 |
| 2020 | 4,367 | 63.8 | 36.4 |
| 2021 | 4,343 | 73.4 | 41.9 |
| 2022 | 4,343 | 71.0 | 40.5 |
Each reviewed imagery file was processed using Sound Metric’s proprietary software ARISFish (v2.6.3 – v2.8.0). First, raw image files were background subtracted, which removed static objects from the image so that only objects in motion are shown. Then, an echogram was created, which transformed the image into a graph of distance (y-axis) and time (x-axis), so that objects in motion appeared as white “tracks.” The echogram enabled the data reviewer to quickly navigate to parts of the image file that contained objects that could be migrating fish. These tracks were then manually viewed alongside the raw image file to determine if the object was a fish to be further investigated.
Fish greater or equal to 45 centimeters (cm) were measured, marked, and counted using the ARISFish software. Forty-five cm was determined to be the minimum length of a potential steelhead, based on captures of steelhead during sampling in the Dungeness River 2014, 2015, and 2017 by the Jamestown S’Klallam Tribe (JSK) (unpublished data, C. Burns). Only fish that completely moved through the SONAR beams were counted; fish that nosed in and out or did not completely move from one side of the beams to the other were not counted. For each fish counted the following data were recorded:
If no fish were observed in the 30-minute image file, a line of data with “NO FISH” was recorded to indicate that the file was reviewed for fish, but no fish \(\geq\) 45 cm were present. Marked fish were automatically saved within the image file for later error checking; data were also recorded within an Excel spreadsheet for data summarization and analysis.
In several years (2019 - 2022), a subset of SONAR footage was reviewed by all (two or three) of that years’ observers (Table 2.3). Within that subset of data, we summed the counts of each observer by date and direction, and examined the correlations between counts of different observers using the Pearson correlation coefficient. One observer (initial AS) was an observer every year, while other observers worked for one or two years only. We combined the daily counts across years when computing the correlation between observers. We also computed separate correlations for upstream and downstream counts.
To compare length measurements, we attempted to group individual observer detections of the same fish. We did this by first grouping fish detected in the same hour period moving in the same direction. If there was more than one fish detected in that group, we assumed that the relative lengths assigned by each observer corresponded to the same fish (i.e. the smallest observed fish by observer A was also the smallest observed fish by observer B). We then calculated the mean, standard deviation and coefficient of variation (CV) of the length measurements for each fish. Because observer AS was the most experienced, and measured nearly every fish, we also compared other observer length measurements against those by AS, and treated the measurements by AS as the benchmark for these comparisons. We summarized those differences with statistics like mean bias, mean absolute error (MAE), root mean squared error (RMSE) and mean absolute percent error (MAPE).
| Year | n Days | n Hours | n Fish |
|---|---|---|---|
| 2019 | 5 | 32 | 54 |
| 2020 | 6 | 34 | 51 |
| 2021 | 12 | 65 | 92 |
| 2022 | 14 | 69 | 116 |
Species composition sampling was conducted weekly, as river conditions allowed, during the period of SONAR operations in 2021 and 2022. A fine monofilament gill net 36 feet wide by 8 feet deep with a 2-inch mesh (4-inch stretch) was drifted through all sampleable habitat in the lower river from RM 3.3 to RM 0.5 (2021) or RM 0.8 (2022). Encountered fish were removed immediately from the net, sedated in a solution of tricaine mesylate (MS-222), and sampled for species, origin, length, sex, scales, and DNA. Captured steelhead were assessed for kelt status.
No regular species composition sampling was conducted in 2018, 2019, or 2020. In 2019, three sampling efforts targeting bull trout were conducted once per week in June at sites throughout the Dungeness and Gray Wolf rivers.
Bull trout are swimming past the sonar unit as well as steelhead, and we needed to parse which fish identified by the sonar were steelhead, and exclude any bull trout. The largest bull trout sampled in any species composition data was 67 cm, so we assumed any fish larger than 67 cm detected on the sonar was a steelhead. We then needed to determine of the fish equal to or less than 67 cm long, which of those are steelhead, and which are something else (e.g. bull trout, rainbow trout).
We only have species composition data for two years, 2021 and 2022. It was collected weekly, using tangle nets just upstream of the sonar location. For every fish caught, we know the date and fork length of that fish.
We modeled the probability of a fish being a steelhead using fork length and the Juilan day of capture. Since we only care about differentiating steelhead, we grouped resident rainbow and cutthroat trout with bull trout, and then fit a binomial GAM with a logit link, using splines of fork length and Julian day to predict the probability of a fish being a steelhead. We did not restrict the dataset to fish with fork lengths less than 67 cm, because larger fish have information about the shape of the logistic curve.
After fitting this GAM, we predicted the probability of being a steelhead for all fish observed on the sonar that were smaller than or equal to 67 cm, based on their length and Julian day of observation. Any fish with a probability of 50% or greater we assigned to be a steelhead.
Although data was collected for the 2018 run year, the data quality was insufficient to estimate a steelhead abundance for that year. Frequent milling behavior at the SONAR site, counts that were much higher than subsequent years, and the fact that only 22% of the season was actually reviewed (Table 2.4) led us to treat 2018 as a pilot year and not make an escapement estimate.
| Year | First Day | Last Day | n Periods | n Operational | n Reviewed | Pct Operational | Pct Reviewed |
|---|---|---|---|---|---|---|---|
| 2018 | Feb 01 | Jun 15 | 6,478 | 1,851 | 1,845 | 28.6% | 28.5% |
| 2019 | Feb 01 | Jun 15 | 6,478 | 4,688 | 2,632 | 72.4% | 40.6% |
| 2020 | Feb 01 | Jun 15 | 6,526 | 4,084 | 2,506 | 62.6% | 38.4% |
| 2021 | Feb 01 | Jun 15 | 6,478 | 6,070 | 3,463 | 93.7% | 53.5% |
| 2022 | Feb 01 | Jun 15 | 6,478 | 5,738 | 3,276 | 88.6% | 50.6% |
For 2019 - 2022, SONAR fish targets that were larger than 67 cm or had a greater than 50% probability of being a steelhead, moved completely through the SONAR beams (direction of travel was upstream or downstream), and had a data reviewer confidence of 1 were included in the final steelhead counts and abundance estimate. Based in part on the species composition data, we determined that the steelhead run on the Dungeness is over by mid-June, so we restricted the steelhead season to SONAR observations or predictions between February 1 and June 15.
To fill in the missing data from periods when the SONAR was not operating or the data had not been reviewed, this dataset was fit with a negative binomial generalized additive model (GAM) with a log link function using hour of day, discharge (from a USGS gauge on the Dungeness River, summarized at the hour time-scale) and Julian day-of-year as covariates. The GAM include a cubic spline for the hour of day, a thin-plate spline for discharge, and a factor spline for day of year, including an interaction between year and day of year. This GAM was then used to predict the upstream and downstream numbers of steelhead during all missing data periods, from February 1 through June 15 each year. This included all half hours when the SONAR was not operational for the entire 30 min, as well as all half hours that were not reviewed.
To combine the upstream and downstream estimates, we made one simplifying assumption related to kelting behavior. Prior to May 15, we subtracted the total estimate of downstream moving fish from the total estimate of upstream moving fish. This is to prevent fish that are milling (moving upstream, then downstream, then upstream again) from being double counted. After May 15, we ignored downstream moving fish and only estimated upstream moving fish, under the assumption that downstream moving fish are steelhead kelts that have spawned and therefore should not be subtracted from our escapement estimates. Obviously there may be kelts prior to May 15, and there may be milling fish after that date, but our assumption is that the number of downstream moving kelts prior to that date equals the number of downstream milling fish after that date.
After summing the counts across days when each pair of observers reviewed the same footage, Table 3.1 shows the total counts by year and direction (upstream vs. downstream) for each observer. Generally the upstream counts are very well aligned, and the downstream counts are close although they show more observer-to-observer variability than upstream counts.
| Year | Direction | AS | BC | BT | CS | GB | JG |
|---|---|---|---|---|---|---|---|
| 2019 | Upstream | 38 | 38 |
|
|
|
|
| 2019 | Upstream |
|
38 |
|
|
|
37 |
| 2019 | Upstream | 38 |
|
|
|
|
37 |
| 2020 | Upstream | 31 |
|
32 |
|
|
|
| 2021 | Upstream | 14 |
|
13 |
|
|
|
| 2021 | Upstream | 26 |
|
|
26 |
|
|
| 2021 | Upstream |
|
|
3 | 3 |
|
|
| 2022 | Upstream | 47 |
|
|
48 |
|
|
| 2022 | Upstream | 54 |
|
|
|
40 |
|
| 2022 | Upstream |
|
|
|
46 | 32 |
|
| 2019 | Downstream | 6 | 7 |
|
|
|
|
| 2019 | Downstream |
|
7 |
|
|
|
5 |
| 2019 | Downstream | 9 |
|
|
|
|
7 |
| 2020 | Downstream | 15 |
|
12 |
|
|
|
| 2021 | Downstream | 19 |
|
19 |
|
|
|
| 2021 | Downstream | 24 |
|
|
20 |
|
|
| 2021 | Downstream |
|
|
6 | 1 |
|
|
| 2022 | Downstream | 20 |
|
|
12 |
|
|
| 2022 | Downstream | 24 |
|
|
|
13 |
|
| 2022 | Downstream |
|
|
|
9 | 6 |
|
The correlation coefficient between each pair of observers, by direction, is show in Table 3.2. Except for observer GB, Correlations for upstream moving fish were all greater than 0.97, while the correlation coefficients for downstream moving fish ranged from -0.25 to 0.87. Several of the weakest correlations did correspond with lower numbers of observed fish.
| Direction | Obs 1 | Obs 2 | N Days | Obs 1 Fish | Obs 2 Fish | r |
|---|---|---|---|---|---|---|
| Upstream | AS | BC | 5 | 38 | 38 | 0.991 |
| Upstream | AS | JG | 5 | 38 | 37 | 0.998 |
| Upstream | AS | BT | 11 | 45 | 45 | 0.976 |
| Upstream | AS | CS | 15 | 73 | 74 | 0.951 |
| Upstream | AS | GB | 10 | 54 | 42 | 0.404 |
| Upstream | BC | JG | 5 | 38 | 37 | 0.995 |
| Upstream | CS | GB | 8 | 46 | 42 | 0.495 |
| Downstream | AS | BC | 3 | 6 | 7 | 0.866 |
| Downstream | AS | JG | 4 | 9 | 7 | 0.174 |
| Downstream | AS | BT | 10 | 34 | 31 | 0.863 |
| Downstream | AS | CS | 14 | 44 | 33 | 0.654 |
| Downstream | AS | GB | 7 | 24 | 13 | 0.541 |
| Downstream | BC | JG | 3 | 7 | 7 | 0.500 |
| Downstream | CS | GB | 5 | 9 | 13 | -0.250 |
For fish observed by multiple observers, the CVs of those multiple length measurements are displayed in Figure 3.1. The mean CV of length measurements for upstream moving fish was 0.06, while it was 0.09 for downstream moving fish. 95% of the upstream CVs were smaller than 0.15 (considered a reference point for precise measurements), while 84% of the downstream CVs met this criteria.
Figure 3.1: Coefficient of variation (CV) of length measurements for individual fish across multiple observers, colored by year and faceted by direction of movement. Dashed lines indicate the mean CV for that group, while the solid black line is a reference of 0.15.
Histograms of length measurement bias, relative to observer AS, are shown in Figure 3.2. Summary statistics of the same comparison are depicted in Table 3.3. All observers had larger variability in their measurements of downstream moving fish compared to observer AS, as seen in RMSE, MAE and MAPE values. Two observers (BT and GB) had a positive mean bias relative to observer AS for upstream fish and BT also had a positive mean bias for downstream fish, meaning they often measured the same fish as being slightly larger than AS. The other observers had negative mean bias, meaning they measured the same fish as being smaller compared to observer AS. This was more pronounced for downstream moving fish, up to an mean difference of nearly -12.4 cm per fish for observer BC (although that observer only measured four downstream fish).
The mean absolute percent error (MAPE) ranged from 6.7 - 12.3% for upstream moving fish and from 8.9 - 18.2% for downstream moving fish. To put that on the scale of fish lengths (centimeters), the root mean square error (RMSE) ranged from 6.7 - 9.6 cm for upstream moving fish and 6.8 - 17 cm for downstream moving fish.
Figure 3.2: Histograms and density plots showing the bias of length measurements, relative to observer AS, colored by observer and faceted by direction and year.
| Direction | Observer | N Fish | Mean Bias | RMSE | MAE | MAPE |
|---|---|---|---|---|---|---|
| Upstream | CS | 63 | -1.1 | 7.8 | 5.7 | 8.9 |
| Upstream | BT | 41 | 1.5 | 8.3 | 5.7 | 9.1 |
| Upstream | JG | 37 | -6.3 | 8.3 | 6.8 | 9.3 |
| Upstream | BC | 36 | -2.3 | 6.7 | 4.9 | 6.7 |
| Upstream | GB | 29 | 1.9 | 9.6 | 7.4 | 12.3 |
| Downstream | BT | 24 | 1.5 | 9.7 | 7.4 | 12.6 |
| Downstream | CS | 23 | -4.4 | 6.8 | 6.0 | 8.9 |
| Downstream | GB | 7 | -2.0 | 15.1 | 12.4 | 18.2 |
| Downstream | JG | 5 | -7.4 | 12.1 | 10.7 | 13.0 |
| Downstream | BC | 4 | -12.4 | 17.0 | 13.0 | 14.5 |
Thirty-three species composition sampling events were conducted between early February and late June across 2021 and 2022. Steelhead and bull trout were the primary species encountered during sampling. The majority of captured steelhead were natural-origin; three hatchery-origin steelhead were captured in early April 2021, and three hatchery-origin steelhead were captured in 2022 - two in mid-March and one in late May. Steelhead kelts were encountered starting in early June 2021 and in May 2022 (Table 3.4). From the species composition netting, there are 92 fish to use in this model. The lengths of these fish can be seen in Figure 3.3.
| Year | Date | Bull Trout | Resident Rainbow | Cutthroat | Steelhead (UM) | Steelhead (AD) | Steelhead Kelt |
|---|---|---|---|---|---|---|---|
| 2021 | Feb 17 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2021 | Feb 22 | 0 | 0 | 0 | 2 | 0 | 0 |
| 2021 | Feb 25 | 0 | 0 | 0 | 2 | 0 | 0 |
| 2021 | Feb 26 | 0 | 0 | 0 | 1 | 0 | 0 |
| 2021 | Mar 03 | 0 | 0 | 0 | 1 | 0 | 0 |
| 2021 | Mar 04 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2021 | Mar 17 | 0 | 0 | 0 | 1 | 0 | 0 |
| 2021 | Mar 18 | 0 | 0 | 0 | 1 | 0 | 0 |
| 2021 | Mar 25 | 0 | 0 | 0 | 2 | 0 | 0 |
| 2021 | Mar 26 | 0 | 1 | 0 | 1 | 0 | 0 |
| 2021 | Apr 01 | 1 | 0 | 0 | 1 | 1 | 0 |
| 2021 | Apr 06 | 2 | 0 | 0 | 0 | 0 | 0 |
| 2021 | Apr 07 | 0 | 0 | 0 | 2 | 0 | 0 |
| 2021 | Apr 08 | 0 | 0 | 0 | 4 | 2 | 0 |
| 2021 | Apr 14 | 0 | 0 | 0 | 4 | 0 | 0 |
| 2021 | Apr 15 | 3 | 0 | 0 | 0 | 0 | 0 |
| 2021 | Apr 16 | 1 | 0 | 0 | 1 | 0 | 0 |
| 2021 | Apr 28 | 0 | 0 | 0 | 1 | 0 | 0 |
| 2021 | May 05 | 0 | 0 | 0 | 1 | 0 | 0 |
| 2021 | Jun 08 | 4 | 2 | 0 | 1 | 0 | 1 |
| 2021 | Total | 13 | 3 | 0 | 26 | 3 | 1 |
| 2022 | Feb 02 | 3 | 0 | 1 | 0 | 0 | 0 |
| 2022 | Feb 15 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2022 | Feb 22 | 0 | 0 | 0 | 2 | 0 | 0 |
| 2022 | Mar 09 | 1 | 0 | 0 | 1 | 1 | 0 |
| 2022 | Mar 16 | 0 | 0 | 0 | 2 | 1 | 0 |
| 2022 | Mar 23 | 1 | 0 | 0 | 1 | 0 | 0 |
| 2022 | Mar 30 | 0 | 0 | 0 | 2 | 0 | 0 |
| 2022 | Apr 07 | 1 | 0 | 0 | 3 | 0 | 0 |
| 2022 | Apr 19 | 2 | 0 | 0 | 7 | 0 | 0 |
| 2022 | May 04 | 2 | 0 | 0 | 6 | 0 | 4 |
| 2022 | May 20 | 2 | 0 | 0 | 2 | 1 | 2 |
| 2022 | Jun 01 | 2 | 0 | 0 | 1 | 0 | 1 |
| 2022 | Jun 22 | 1 | 0 | 0 | 0 | 0 | 0 |
| 2022 | Total | 16 | 0 | 1 | 27 | 3 | 7 |
Figure 3.3: Histogram of forklengths, colored by species. Dashed lines are the overlap range between steelhead and other species.
The impacts of Julian day and fork length on the probability of a fish being a steelhead are displayed in Figure 3.4. Generally, larger fish have a greater chance of being a steelhead, but the exact break point of length (i.e. 50% probability of being a steelhead) shifts over the course of the season.
Fish greater than 67 cm were deemed steelhead, regardless of the Julian day of year they were observed. Fish less than or equal to 67 cm were deemed steelhead if the predicted probability of being a steelhead from our GAM model was greater than or equal to 50%. The number of fish within each category is shown in Table 3.5.
Figure 3.4: Julian day and fork length of each fish detected on SONAR, colored by the predicted probability of being a steelhead. Size of the point corresponds to the precision of the predicted probability (larger points indicate greater precision). Dark line indicates the 50% probability of being a steelhead. Dashed horizontal lines depict 45 and 67 lengths for reference.
| Direction | Year | n Fish | Likely Sthd | n Sthd | n Fish | Likely Sthd | n Sthd | Total Sthd |
|---|---|---|---|---|---|---|---|---|
| Upstream | 2019 | 268 | 136 | 136 | 477 | 477 | 477 | 613 |
| Upstream | 2020 | 416 | 280 | 280 | 414 | 414 | 414 | 694 |
| Upstream | 2021 | 266 | 148 | 148 | 496 | 473 | 496 | 644 |
| Upstream | 2022 | 450 | 292 | 292 | 284 | 281 | 284 | 576 |
| Downstream | 2019 | 95 | 50 | 50 | 207 | 207 | 207 | 257 |
| Downstream | 2020 | 234 | 145 | 145 | 119 | 119 | 119 | 264 |
| Downstream | 2021 | 205 | 110 | 110 | 214 | 210 | 214 | 324 |
| Downstream | 2022 | 198 | 120 | 120 | 109 | 108 | 109 | 229 |
The estimated marginal effects of various covariates on the expected number of upstream and downstream moving fish are shown in Figures 3.5 and 3.6 respectively. For both directions, the model indicates that a greater number of steelhead will move during the night, especially in the late evening, compared to the daytime, and more will move when discharge flows are near 600 cfs. There is also a clear effect of day-of-year, with upstream numbers peaking near the beginning of April, while downstream numbers peak near the beginning of May, with some year-to-year variability in that run-timing curve.
Estimates of early, late and total annual escapement of winter steelhead are shown in Table 3.6.
| Year | Estimate | SE | Low CI | Upp CI | Estimate | SE | Low CI | Upp CI | Estimate | SE | Low CI | Upp CI |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2019 | 762 | 146.9 | 658 | 1,160 | 152 | 7.3 | 140 | 168 | 913 | 147.2 | 808 | 1,317 |
| 2020 | 961 | 43.1 | 878 | 1,045 | 140 | 17.5 | 112 | 181 | 1,101 | 47.1 | 1,012 | 1,196 |
| 2021 | 579 | 8.9 | 562 | 597 | 67 | 4.8 | 59 | 78 | 646 | 10.8 | 626 | 668 |
| 2022 | 610 | 11.4 | 587 | 629 | 138 | 8.3 | 123 | 156 | 747 | 14.8 | 719 | 776 |
Figure 3.5: Marginal effects for upstream-moving fish as estimated by the GAM for hour of day (A), discharge (B), and Julian day of year (C). Shaded areas indicated 95% confidence intervals.
Figure 3.6: Marginal effects for downstream-moving fish as estimated by the GAM for hour of day (A), discharge (B), and Julian day of year (C). Shaded areas indicated 95% confidence intervals.
We used SONAR to make annual estimates of winter steelhead on the Dungeness River for spawn years 2019 - 2022. To do so, we needed to collect and utilize independent species composition data, and develop an analysis technique that allowed us to estimate passage during periods when the SONAR was not operable or the video had not been reviewed. In addition, analyzing these initial years of data has prompted several questions worth mentioning.
First, the variability between observers was relatively small. The total counts between pairs of observers each year were very similar, especially for upstream moving fish (Table 3.1). The coefficient of variation among different observers’ length measurements was quite small, suggesting good consistency across observers. It should be noted that we matched up which fish each observer measured in such a way as to minimize observer-to-observer differences for multiple fish observed in the same half-hour period. The overall bias in measurements, compared to observer AS, was quite low, but not zero. This could have an impact on whether a fish is predicted to be a steelhead or not, since length is a determining covariate in the species prediction model. However, Figure 3.2 suggests that there are differences in length measurements in both the positive and negative direction, so the impact on steelhead counts should be minimal.
Second, SONAR location is a crucial component of a successful SONAR project. After observing the fish behavior at the initial location in 2018, the decision was made to move the SONAR to a habitat unit that was more of a riffle, conducive to fish moving through rather than milling around.
Bethany, anything to add here about location choices?
In addition to the location, several factors in 2018 led to unrealistic estimates of escapement. The amount of time when the SONAR was either not in operation or that went un-reviewed in 2018 was much higher than in other years (Figures 2.4 and 2.5 and Table 2.4). In addition, the counts of both upstream and downstream moving fish were much higher in 2018, presumably due in part to more milling behavior at that site. The mean count of upstream moving fish in 2018 in a half-hour period was 1.02, while it ranged from 0.24 - 0.35 in 2019 - 2022. For downstream moving fish it was a mean of 0.70 in 2018, and a range of 0.1 - 0.15 in 2019 - 2022. Due to these reasons, we made the decision to treat 2018 as a pilot year and not make an escapement estimate using SONAR that year, and instead utilize the lessons learned from that year to improve operations in subsequent years.
Third, how to best deal with steelhead kelts is an open question. For fish that move upstream, downstream, and upstream again before spawning, we would like to subtract the downstream counts from the upstream counts, to avoid double-counting the same fish. However, steelhead that kelt may be observed moving upstream and again moving downstream, and we would not like those counts to cancel each other out. Currently, we are sidestepping this issue by assuming that the number of kelts detected prior to May 15 is equal to the number of downstream milling detections after that date. However, that date is at best an educated guess which could lead to bias in our estimates in one direction or the other. Continued investigation of this issue is warranted, perhaps by more closely examining the species composition data for kelting behavior (or changing the species composition sampling to better target kelts) or by analyzing metrics such as the upstream:downstream count ratios through the season, to determine if there is a pattern that could guide what that equilibrium date should be.
Finally, the species composition data, while an extremely important part of this SONAR project, did raise a few issues for future consideration. A few bull trout were captured multiple times in the same pool during species composition netting, suggesting that the species composition sampling may be sampling not just fish that are moving, but also fish that may be holding (i.e. not moving past the SONAR). Whether this is actually impacting the predictions of species based on size and Julian day is unclear. In addition, the current methods cannot account for potential differences in what hour of the day certain species are more or less likely to move. If steelhead are more likely to move at night, we would want to incorporate hour of day into our species prediction. Without a different study design for species composition, we are unable to address this question. However, it seems reasonable to assume that steelhead and bull trout have similar behavior with regards to movement and time of day.
Should we bring anything into the discussion about comparisons between SONAR estimates and redd estimates of escapement?
We recommend in the future trying to set the SONAR unit up earlier in the year, before the steelhead start moving into the Dungeness. Even in 2021, when the SONAR was deployed starting February 1, there was still one steelhead detected on that date, suggesting the run may begin sooner than that. If the SONAR is deployed earlier, then we would also recommend that the species composition sampling begin at the same point in the year that the SONAR is deployed, to ensure that we can identify when steelhead (as opposed to other species) are moving in the Dungeness. After a few years of deploying quite early, we may begin to move that deployment date later with a firmer understanding of when the run starts.
Another recommendation is to investigate the use of image recognition software and machine learning processing to help automate the review of SONAR images. Technicians are required to spend a substantial amount of time reviewing SONAR video, and if that could be reduced it would have multiple benefits. First, cutting hours of tedious review time could potentially be cost-effective, and make the data available for analysis sooner. Second, it would make the counts more reproducible and less subject to an individual observer’s skill and experience. Finally, by automating the review process there would no longer be a need to selectively choose which periods to review (e.g. first 30 minutes of every hour). Instead, counts could be obtained for the entire period the SONAR is deployed, reducing the reliance on estimates for periods with missing data.
Andrew Simmons, Dan Gorze, Jayson Gallatin, Brent Trim, and Greg Boecker of WDFW operated, maintained, and reviewed SONAR imagery data. Calvin Stokes also reviewed SONAR imagery. Peter Topping provided project support and advice. Kathryn Sutton led weekly species composition sampling with the help of many volunteers including Calvin Stokes, Jenni Whitney, Scott Williams, Jeff Gufler, David Thomas, Jacob Portney, Caleb Owen, and Kayla Own of WDFW, Chris Burns, Jarrett Burns, Casey Allen, and Aaron Brooks of the Jamestown S’Klallam Tribe, Dave Shreffler of Shreffler and Associates, Keith Denton of Keith Denton and Associates, and Roger Peters, Roger Tabor, Greg Byford, Evan Lewis, Jakob Bengelink, and Jack Brill of the U.S. Fish and Wildlife Service.